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*-  The  objectives  of  this  study  were  to  extend  the  present  PCB  testability 
design  and  rating  system  developed  by  Grumman  to  the  module,  rack,  and 
subsystem  levels  and  to  generate  an  overall  system  level  testability 
figure  of  merit  (F0M) .  The  F0M  developed  is-  based  on  the  evaluation  of 
a  system,  modelled  as  a  node-valued  weighted  graph,  (a  node  being  each 
individual  PCB  in  the  system) .  This  model  requires  as  inputs  the  test¬ 
ability  ratings  of  each  individual  PCB  (outside  the  system)  as  a  number 
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w  between  0  and  1  •  Tills  FOM  ws>.  validated  on  3  of  Boeing  Aerospaces'  own 
subsystems,  each  containing  a  various  number  of  PCB's.  The  results  of 
the  validation  and  the  development  of  the  FOM  model  are  presented.  This 
model  has  been  computerized  in  the  pascal  computer  language  and  is  pro¬ 
vided  as  part  of  this  report. 
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1.0  INTRODUCTION 


The  rapid  growth  in  the  complexity  of  digital  system  designs  and  the  reduction 
in  the  size  of  such  systems  has  increased  the  scope  of  the  testing  problem 
while  reducing  the  access  to  interior  parts  of  a  system,  which  is  vital  to 
thorough  testing.  As  a  result  of  this  advancing  technology,  system 
testability  has  become  an  important  performance  and  reliability  evaluation 
criterion.  As  part  of  the  process  of  quantifying  testability,  the  objectives 
of  this  program  were  to  extend  the  present  PCB  testability  design  and  rating 
system  developed  by  Grumman  to  the  module,  rack  and  subsystem  levels  and  to 
generate  an  overall  system  level  testability  figure  of  merit.  The  figure  of 
merit  developed  during  this  research  effort  is  highly  versatile  since  it  will 
allow  for  both  the  calculation  of  the  testability  of  an  existing  system  and 
aid  in  the  top  down  design  of  proposed  systems. 


The  remainder  of  Section  1  will  review  the  need  for  a  testability  rating 
system,  outline  the  research  approach,  and  summarize  major  results. 


1.1  The  Need  for  Testability 


The  interrelated  requirements  of  high  mission  effectiveness,  high  system 
availability,  and  low  life  cycle  costs  motivates  the  development  of  highly 
reliable  and  maintainable  military  electronics.  Increasing  levels  of 
component  integration,  the  resulting  limited  access,  and  the  increasing 
complexity  of  systems  have  contributed  to  the  problem  of  high  maintenance 
costs  and  low  system  availability.  The  ability  to  adequately  test  complex 
electronic  systems  is  a  prime  requisite  for  rapid  fault  isolation  and 
correction.  Testability  is  currently  restricted  by  four  major  factors. 
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A.  Inadequate  Test  Equipment 


A  recent  Air  Force  study  (1)  concluded  that  the  number  one  problem  for 
avionic  system  maintenance  is  the  inadequate  fault  Isolation  capabilities 
of  test  equipment.  Without  adequate  equipment  for  fault  isolation,  main- 
tenance  personnel  must  spend  extra  time  locating  and  replacing  suspected 
failures.  In  addition,  automatic  test  equipment  (ATE)  is  subject  to  its 
own  reliability  and  maintainability  problems. 

B.  Lack  of  Design  for  Testability  (DFT) 

For  most  systems,  questions  of  testing  and  maintenance  are  considered 
only  after  the  system  design  has  been  frozen.  The  result  is  that 
concurrent  (operational)  testing  becomes  difficult-to-impossible  and  off¬ 
line  testing  becomes  more  expensive  and  time  consuming  because  of  a  less 
effective  test  capability.  Another  result  is  higher  false  alarm  rates. 

C.  Inadequate  Test  Procedures 

The  move  to  more  reliable  systems  made  up  of  large  scale  integration/ very 
large  scale  integration  (LSI/VLSI)  components  results  in  higher  levels  of 
integration  and  fewer  test  points.  The  classical  testing  requirements  of 
observability  and  controllability  are  severely  affected,  thus  increasing 
the  difficulties  of  testing  systems  using  these  components.  In  addition, 
testing  problems  are  increased  because  of  cannot  duplicate  (CND)  faults 
and  black  box  interface  faults  that  cannot  be  detected  by  test 
procedures.  This  is  a  major  source  of  expense  in  system  testing. 


0.  Complexity  and  Variety  of  Equipment 

Maintenance  tasks  must  be  conducted  on  a  wide  variety  of  complex 
equipment.  Appropriate  training  to  perform  these  tasks  requires  a 
lengthy  time  investment  relative  to  the  average  military  service  period 
of  maintenance  personnel. 

The  result  of  these  factors  is  that  system  testing  and  fault  isolation  occupy 
the  bulk  of  maintenance  time.  Testing  and  maintenance  also  represent  a  high 
percentage  of  aircraft  support  costs  and  form  the  limiting  factor  in  military 
aircraft  reliability.  Fault  isolation  is  often  performed  incorrectly  and 
trouble  shooting  tasks  often  need  to  be  repeated  many  times  before  the 
isolation  process  is  completed.  These  testing  costs  are  apparent  in  the  field 
where  fault  detection  and  isolation  account  for  35%  of  total  maintenance  time. 
In  addition,  up  to  40%  of  the  Line  Replaceable  Unit  (LRU)  removals  are  later 
determined  to  be  "false  alarms"  (2).  These  unnecessary  removals  increase  both 
maintenance  cost  and  time  as  well  as  reduce  system  availability. 

The  solution  to  the  electronic  system  testability  problem  is  the  inclusion  of 
adequate  test  capabilities  during  each  level  of  the  design  process. 

Overall,  design  for  testability  will  reduce  the  following: 

o  Engineering  redesign  costs  since  fewer  designs  would  be  returned 
because  of  the  lack  of  testability. 

o  Test  er  ment  costs  since  test  equipment  need  -  t  ^  as  complex. 
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o  Flow  time  through  production  since  production  testing  time  would  be 
reduced. 

o  Service  time  in  the  field  since  testing  would  require  less  time. 

o  The  number  of  field  failures  since  there  would  be  fewer  latent 

faults. 

Part  of  this  savings  would  be  realized  to  some  degree  from  any  use  of  DFT 
rules.  The  existence  of  a  quantitative  measure  of  testability  used 

concurrently  with  the  DFT  rules  would  have  additional  advantages.  It  would 
provide  the  following: 

o  Help  designers  choose  among  alternative  designs. 

o  Establish  standards  of  testability  compliance  for  the  construction 
of  new  equipment. 

o  Locate  testability  problem  areas  within  a  design  before  the  final 
product  is  produced. 

1.2  Testability  Ratings 

Designing  for  testability  involves  the  careful  consideration  of  three 
concepts:  controllability,  observability,  and  predictability.  Controllabil¬ 
ity  refers  to  the  ease  in  which  a  system  can  be  directed  through  its  various 
functions.  Observability  refers  to  the  ease  in  which  the  internal  status  of 
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the  system  can  be  examined.  Predictability  is  related  to  controllability  and 
refers  to  the  ease  in  which  a  system  can  be  forced  into  a  known  state.  From 
these  concepts,  general  design  rules  can  be  developed  to  improve  system  test¬ 
ability.  For  example,  design  rules  which  enhance  circuit  predictability 
require  the  development  of  synchronizing  digital  and  analog  signal  sequences 
in  all  systems.  Controllability  and  observability  may  be  enhanced  through  the 
use  of  test  points.  These  test  points  may  provide  additional  system  inputs 
for  control  purposes  or  additional  circuit  outputs  for  observation  purposes. 

These  general  design  rules  have  led  to  a  variety  of  specific  design 
implementations.  For  example,  the  well  known  level-sensitive  scan  design 
(LSSD)  is  a  specific  DFT  approach.  The  method  uses  shift  register  latches  as 
sequential  circuit  storage  elements.  These  latches  are  threaded  to  form  a 
shift  register  allowing  all  the  sequential  elements  of  the  circuit  to  be 
tested  by  simply  shifting  test  patterns  through  the  registers.  Having  done 
this,  the  'resulting  problem  is  reduced  to  the  more  straightforward  problem  of 
testing  the  remaining  combinational  elements. 

In  addition  to  highly  structured  design  procedures  such  as  LSSD,  a  large 
number  of  ad  hoc  design  rules  also  exist  which  may  improve  testability.  Most 
of  these  design  rules  operate  to  increase  one  of  the  three  basic  testability 
concepts.  However,  a  major  problem  facing  testability  researchers  is  how  to 
evaluate  the  results  of  applying  these  rules.  A  numerical  rating  which  can 
then  guide  both  the  evaluation  and  design  of  large  systems  is  an  ideal 
approach.  Several  testability  measures  of  this  type  have  been  proposed. 
Dejka  (3)  suggested  a  testability  measure  based  on  several  circuit 
characteristics  including:  size,  number  of  I/O  pins,  and  the  number  of  test 


vectors  or  patterns  (a  test  vector  or  pattern  is  an  applied  input  condition 
which  can  be  used  to  detect  fault  conditions).  Stephenson  and  Grason  (4) 
developed  a  testability  rating  based  on  controllability  and  observability 
characteristics.  Their  rating  is  limited  to  the  register  transfer  level 
representation  of  the  circuit.  These  and  other  existing  testability  measures 

suffer  from  several  problems  including:  (1)  most  are  based  on  ad  hoc 

procedures,  (2)  they  apply  only  at  the  chip  or  printed  circuit  board  (PCB) 

level  so  the  special  system  level  testability  problems  introduced  by  cables, 
connectors,  etc.,  are  not  considered,  and  (3)  they  lack  general  validation 
since  they  have  been  applied  to  only  one  or  two  systems. 

Another  testability  rating  system  was  recently  developed  by  Grumman  Aerospace 
(5).  The  system  rates  PCBs  on  four  positive  basic  testability  factors  and  30 
negative  testability  factors.  The  overall  PCB  testability  rating  is 
determined  by  subtracting  the  negative  factors  score  from  the  positive  factors 
score.  This  rating  was  validated  by  applying  the  procedure  to  17  PCBs  and 
comparing  the  resulting  testability  score  to  the  independent  evaluation  of 
testability  made  by  several  expert  engineers.  This  measure,  which  has 

generated  a  great  deal  of  interest  and  significant  use  in  industry,  served  as 
the  takeoff  point  for  development  of  the  system  level  figure  of  merit  (FOM) 
proposed  in  this  report. 

1.3  Research  Approach 

Preliminary  research  and  review  of  the  technical  literature  led  to  the 
conclusion  that  the  most  logical  approach  for  deriving  a  system  level  FOM 
would  be  based  on  a  signal  flow  graph  model. 
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The  approach  to  extending  the  PCB  testability  FOM  to  the  system  level  thus 
involved  four  tasks.  The  first  task  consisted  of  a  survey  of  Boeing  equipment 
and  selection  of  a  set  of  small  digital  systems  (consisting  of  multiple  PCB's) 
for  use  in  the  FOM  verification/validation  task.  Once  the  equipment  was 
selected,  the  Grumman  testability  FOM  was  calculated  for  each  PCB  in  three 
systems.  The  second  task  required  the  development  of  guidelines  for  creating 
a  node-valued  weighted  graph  model  to  determine  testability  of  items  comprised 
of  electronic  circuits/functions.  This  model  would  be  used  to  extend  the  PCB 
testability  FOM  to  the  subsystem/system  levels  (i.e.,  "black  box").  The  third 
task  involved  the  verification  and  validation  of  the  system  testability  FOM. 
Here  the  model  was  applied  to  each  system  selected  in  task  one.  The 
testability  FOM  was  then  compared  with  actual  testing  experience  in  order  to 
validate  or  suggest  changes  in  the  model.  Finally,  in  task  four,  a  higher 
level  system  application  of  the  testability  FOM  was  made  to  serve  as  a  guide 
to  the  application  of  the  testability  measure  at  higher  levels  (where  a  system 
consists  of  subsystems,  or  "black  boxes",  each  containing  multiple  PCB's). 

1.4  Summary  of  Results 

Several  different  mathematical  approaches  to  the  problem  of  testability 
evaluation  (using  different  types  of  nodal  modeling  techniques)  were  explored. 
The  method  finally  selected,  the  Accessibility  Model,  has  the  following 
advantages: 

1.  It  works  on  both  analog  and  digital  circuits,  provided  each  component's 
testability  and  interaction  with  other  components  are  known. 


2.  It  works  on  feedback  loops. 


3.  It  allows  for  the  decomposition  of  complex  systems  into  easy  to  solve 
subsystems. 

This  model  was  applied  to  three  Boeing  systems  and  produced  testability  FOM's 
which  were  in  general  agreement  with  the  observed  testability  experience  on 
the  systems. 


2.0  TESTABILITY  SURVEY 


In  general,  there  are  two  methods  of  determining  system  testability:  the 
scorecard  method  and  an  algorithmic  method.  Scorecard  methods  involve  the 
analysis  of  circuit  features  which  enhance  or  detract  from  testability.  Each 
feature  is  weighted  and  the  weights  are  combined  to  form  a  testability  factor 
for  the  circuit.  Dejka  (3),  for  example,  suggested  a  testability  measure 
based  on  several  circuit  characteristics  including:  size,  number  of  I/O  pins, 
and  the  number  of  test  vectors  (patterns).  Grumman  Aerospace  (5)  developed  a 
PCB  testability  score  for  the  Rome  Air  Development  Center  (RADC).  This  system 
rates  PCB's  on  four  positive  and  30  negative  testability  factors.  The  overall 
PCB  testability  score  is  determined  by  the  difference  between  the  negative 
factors  and  the  positive  factors.  Grumman  validated  the  procedure  on  a  sample 
of  17  PCB's  by  comparing  the  PCB  testability  score  to  an  independent 
evaluation  of  testability  made  by  expert  engineers.  Scorecard  systems  are 
easily  implemented  and  are  tied  directly  to  the  circuit  design.  However,  they 
provide  a  very  coarse  measure  of  testability  and  cannot  be  manipulated  to 

study  the  nature  of  testability.  In  addition,  scorecard  systems  do  not  allow 
development  of  a  rigorous  model  for  calculating  system  level  testability 

taking  into  account  the  Influence  of  testability. 

Algorithmic  methods  provide  a  mathematical  approach  to  testability  calculation 
based  on  an  analysis  of  the  topological  structure  of  the  circuit.  Goldstein 
(6),  for  example,  describes  the  testability  of  a  circuit  by  assigning  six 

values  to  each  circuit  element:  combinational  0  and  1  controllabilities, 

sequential  0  and  1  controllabilities  and  both  combinational  and  sequential 
observabilities.  These  values  are  propagated  across  the  devices  in  the 
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circuit  and  are  used  as  a  measure  of  circuit  testability.  Dussault  (7) 
analyzes  circuit  testability  based  on  information  theory.  Controllability  and 
observability  are  defined  as  circuit  entropies.  Breuer  and  Friedman  (8)  using 
TEST/80  define  a  cost  function  which  reflects  the  cost  of  testing  along  a 
given  path  in  the  circuit.  Based  on  a  O-algorithm  like  procedure,  TEST/80 
determines  both  controllability  and  observability  costs  which  may  be  used  to 
determine  system  testability.  British  Telecom  has  also  developed  a  measure  of 
testability  called  CAMELOT  (computer-aided  measure  of  testability)  (9). 
CAMELOT  assigns  a  controllability  and  an  observabi lity  value  to  each  circuit 
node  and  propagates  these  values  through  the  circuit  using  controllability  and 
observability  transfer  functions  which  are  defined  for  each  circuit  element. 
The  testability  of  a  node  is  determined  by  the  product  of  the  node's 
controllability  and  observability.  The  overall  system  testability  is  the 
average  of  the  testabilities  of  the  circuit  nodes.  Algorithmic  measures  of 
testability  are  very  difficult  to  calculate  for  large  systems  since  they 
require  extensive  manipulation  of  transfer  functions  at  the  gate  level.  In 
addition,  they  do  not  respond  to  the  specific  details  of  the  circuit 
implementation  which  may  influence  overall  testability. 

In  the  following  subsections  several  current  methods  for  testability 
evaluation  that  were  investigated  are  reviewed  for  applicability  to  this 
contract  and  the  strengths  and  weaknesses  of  the  resulting  testability  figures 
of  merit  are  evaluated. 
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2.1  SCOAP 
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Goldstein  developed  one  of  the  first  testability  FOM'S  in  1979  (6).  His 
approach  involves  the  analysis  of  two  quantities:  a  controllability  value  and 
an  observabi lity  value.  Six  measures  are  used  to  characterize  the 
controllability  and  observability  of  a  circuit: 


Combinational  0  controllability 
Combinational  1  controllability 
Sequential  0  controllability 
Sequential  1  controllability 
Combinational  observability 
Sequential  observability 


SCOAP  testability  analysis  of  a  circuit  assigns  a  value  to  each  of  the  six 
controllability/observability  qualities  for  each  circuit  element.  The  values 
are  determined  for  each  device  by  the  direct  analysis  of  the  controllability 
and  observabi  lity  of  the  input  lines  and  the  calculation  of  the 
controllability  and  observability  of  the  output  lines. 


SCOAP  has  been  programmed  and  runs  efficiently  even  for  large  systems.  Run 
times  of  only  3-4  min  for  200  element  circuits  have  been  reported.  However, 
SCOAP  does  not  produce  a  single  FOM  for  overall  testability.  Goldstein 
suggests  two  possible  summary  analysis  methods.  First,  construct  a 
testability  profile.  This  is  a  graph  of  the  controllability  or  observability 
vs.  the  number  of  nodes.  The  profile  forms  a  visual  summary  of  the  overall 
testability.  Second,  Goldstein  suggests  using  either  the  maximum 
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controllability  or  the  maximum  observability  value  as  a  summary  FOM.  Another 
major  drawback  of  this  method  is  It  does  not  evaluate  analog  circuits. 

2.2  Hybrid  Method 

Longendorfer  developed  a  testability  FOM  originally  for  analog  circuits  and 
later  extended  it  to  digital  circuits  (10).  Her  method  involves  several 
steps,  the  first  of  which  requires  reducing  the  circuit  to  an  equivalent 
signal  flow  graph.  As  a  result,  circuit  elements  at  the  same  level  are  lumped 
together  in  the  graph  as  a  circuit  block.  A  testability  measure  for  each 
block  is  determined  by  equation  1. 

tj  -  (1  +  log  Sj)  Cj  (1) 

where  Sj  *  sequential  level  of  the  block  j 
Cj  *  number  of  nodes  in  block  j 

The  larger  tj,  the  less  testable  the  block.  The  overall  testability  measure 
is  given  by  equation  2. 


Where  P  *  fraction  of  block  inputs  or  outputs  directly  driven  or  sensed 
during  test 

8  *  number  of  blocks  in  the  circuit 

Longendorfer ' s  method  Is  sensitive  to  controllability,  but  insensitive  to 
observability.  In  addition,  feedback  loops  are  grouped  together  into  a  single 
block  so  the  method  does  not  respond  well  to  sequential  circuits. 


2.3  CAMEtOT 


British  Telecom  currently  uses  a  testability  assessment  program  called  CAMELOT 
(9).  CAMELOT  defines  a  controllability,  (CY),  and  observability,  (OY),  for 
each  circuit  element.  The  controllabi lity  value  for  a  circuit  element  (or 
node)  is  determined  by  its  output  controllability  given  by  equation  3. 


where 


CY  (output)  =  CTF  x  f  (CY  (inputs)) 


=  a  controllability  transfer  factor 


CY  =  1  for  primary  input 

CY  =1  for  other  nodes 

f  =  a  function  of  input  controllabilities 

The  function,  f,  is  a  modified  arithmetic  mean  of  the  input  CY's.  The  observ¬ 
ability,  (OY),  of  a  circuit  element  is  determined  by  its  output  observability: 


where 


OY  (output)  *  OTF  x  0Y( inputs)  x  g  (CY  (inputs)) 


OTF  =  an  observability  transfer  factor 
OY  =  1  for  primary  inputs 
OY  =  1  for  other  nodes 

g  s  a  function  of  the  input  controllabilities 


The  function,  g,  is  similar  to  f  in  that  it  is  a  modified  arithmetic  mean  of 
the  input  CYs. 
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A  system  level  measure  of  testability  is  determined  by  first  assigning  a  test 
ability  value  (TY)  to  each  circuit  element: 


™node  “  ^node  x  ^^node  (5) 

Then,  the  overall  testability  is  the  average  of  the  node  testabilities  for  the 
circuit. 

This  method  requires  a  large  amount  of  computational  effort  for  large  circuits 
and  using  equation  5  tends  to  underestimate  the  actual  node  testabilities. 

2.4  A  Functional  Level  Calculus  of  Testability 

Nippon  Electric  Company  has  developed  a  testability  FOM  based  on  Goldstein's 
controllability/observability  measures  (11).  The  method  requires  a  gate  level 
description  of  the  network  and  utilizes  the  following  definitions: 

0  -  Controllability 

The  number  of  circuit  elements  which  need  to  be  set  to  a  known 
value  for  obtaining  a  logical  0  at  the  specified  element. 

1  -  Controllability 

The  number  of  circuit  elements  which  need  to  be  set  to  a  known 
value  for  obtaining  a  logical  1  at  the  specified  element. 


Observability 

The  number  of  circuit  elements  which  need  to  be  set  to  a  known 
value  for  propagating  a  logical  value  of  a  specified  element  to 
primary  outputs. 

Given  a  circuit  at  the  gate  level,  the  0-control lability,  1-controllability 
and  observability  of  each  gate  may  be  calculated  by  the  direct  application  of 
the  definitions.  In  general,  in  collections  of  gates  from  functional  blocks 
(i.e.,  chips)  the  controllability  of  a  functional  block  is  given  by 
equation  6: 

C(FB)  =  [(Wa  .  A(FB))2  +  (tfb  .  B(FB))2J  **  (6) 

where 

A(FB)  =  (M0  0-Control labi 1 i tv) 

1  Number  of  pins 

B(FB)  ■?(«!,  .  1-Controllability) 

'  Number  of  pins  ^ 

Wa.  Wfa,  W0it  wii  *  weighting  factors 

The  summation  is  over  the  inputs  and  outputs  of  the  functional  blocks.  The 
observability  of  the  functional  block  is  given  by  equation  7: 

0(F8)  .  Observability)  (7) 

Number  of  pins 

where  WO^  =  a  weighting  factor 

The  sum  is  over  the  inputs  and  outputs  of  the  functional  block.  Finally,  the 
overall  testability  of  the  circuit  is  given  by  equation  8: 


T(FB) 


(8) 


*  [(Wc  .  C(FB))1 2 3  +  (WQ  .  0(FB))2^J  ** 

where  Wc  and  WQ  *  weighting  factors 

Clearly,  this  method  has  so  many  weighting  factors  that  it  is  questionable  as 
to  whether  the  engineer's  ability  to  choose  weighting  factors  or  the 
testability  is  really  being  measured. 

2.5  TESTSCREEN 

TESTSCREEN,  developed  at  the  Sperry  Research  Center,  is  an  attempt  to  use 
Goldstein's  Controllability/Observability  values  along  with  information  on 
network  size  and  the  number  of  input/output  pins  to  determine  testability 
(12).  The  method  begins  by  applying  SCOAP  to  determine  the  six  C/0  values: 
CCO,  CC1,  SCO,  SCI,  CO,  SO.  For  a  combi  national  circuit,  TESTSCREEN  has  a 
five  step  procedure  for  calculation  of  overall  testability: 

(1)  Find  the  number  of  reconvergent  fanouts  and  feedback 
loops  (RAF): 

RAF  =  FANOUTS  -  NODES  +  OUTPUTS 

(2)  Find  the  number  of  representative  faults 

FAULTS  =  2  X  (INPUTS  +  RAF) 

(3)  Find  the  circuit  size 

newsize  *  Exults 

where  K  *  a  constant  (Sperry  uses  2.05) 


(4)  Calculate  the  average  control  1 ab i 1 i ty/observabi lity: 

CCO  CC1  CO  SCO  SCI  CO  SO 

srorc,  SOPH,  mgbtc,  noctc,  nsbtc,  nooh,  nock 

(5)  Calculate  testability 
T  »  NEWSIZE  ♦  SCALE 

where  SCALE  *  a  constant 

The  major  problem  with  this  approach  is  the  need  for  a  choice  of  constants, 
although  Sperry  has  found  values  that  work  well  for  them. 

2.6  Other  Approaches 

In  addition  to  the  five  measures  reviewed  there  are  a  wide  range  of  other 
approaches  in  various  stages  of  development.  For  example,  Breuer  and  Friedman 
developed  a  program  called  TEST/80  (8).  This  is  actually  an  automatic  test 
generation  program  for  digital  circuits.  However,  it  is  based  on  a  cost 
analysis  process  which  is  in  efrect  a  controllability/observability  analysis. 
Hence,  their  method  could  be  used  to  generate  a  testability  F0M. 

2.7  Conclusions 

Most  testability  measures  suffer  from  a  series  of  problems  that  include: 

o  Lack  of  Development 

Many  measures  have  been  proposed  and  procedures  for  their 
calculation  have  been  sketched  out  but  they  have  never  been 
developed  to  a  point  where  they  are  useful. 
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o  Theoretically  Unsound 

Most  testability  measures  are  ad  hoc  procedures  with  no  real 
theoretical  basis  which  ties  them  directly  to  the  concept  of 
testability. 

o  Computationally  Intensive 

Some  testability  measures  require  a  great  deal  of  computational 
effort . 

o  Validity  Problems 

Few  testability  measures  have  been  completely  tested  to  determine 
their  relationship  to  actual  testing  costs.  In  fact,  many  measures 
rely  on  so  many  arbitrary  constants  that  it  is  difficult  to 
determine  any  real  relationship  between  testability  and  the  measure. 

o  Unable  to  Guide  the  Design  Process 

Most  testability  measures  are  after-the-fact  measures  that  require 

most  of  the  design  effort  to  be  completed  before  testability  can  be 
evaluated.  As  a  result,  the  testability  measure  cannot  be  used  to 
help  the  designer  improve  the  testability  of  the  circuit  during  the 
design  phase. 

All  of  the  approaches  considered  suffered  from  these  problems  to  some  degree. 
Longendorf er ' s  Hybrid  Method  was  the  only  method  that  could  be  used  during  the 
design  process,  and  it  also  easily  handles  analog  circuits.  As  a  result, 
modification  of  her  approach  toward  the  specific  objectives  of  this  effort 
was  attempted.  Even  with  modification,  though,  it  could  not  be  made  sensitive 
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to  feedback  and  observability.  Based  on  this  experience,  a  new  concept, 
"accessibility",  was  defined  and  the  hybrid  model  restructured  to  Introduce 
the  concept  of  accessibility  of  a  node.  This  resolved  the  feedback  and 
observability  shortcomings  of  the  original  model.  A  full  description  of  the 
Accessibility  Model  and  the  development  process  that  lead  to  It  Is  given  In 
section  4.0,  The  Testability  Model. 
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3.0  THE  GRUMMAN  PCB  TESTABILITY  FIGURE  OF  MERIT 


The  Grumman  PCB  Testability  Figure  of  Merit  System  Mas  developed  by  Grumman 
Aerospace  for  RADC  as  a  means  of  evaluating  digital  PCB  testability  by  inspec¬ 
tion  (5).  As  mentioned  in  section  2.0  it  is  a  scorecard  system  Mhich  rates  a 
PCB  in  4  positive  and  30  negative  factors.  These  factors  are  tallied  to 
produce  a  score  in  the  range  of  -infinity  to  +100.  Table  3-1  shows  the 
relationship  between  Grumman  scores  and  testability.  Experience  indicates 
that  scores  typically  fall  in  a  range  of  -80  to  +90.  It  should  be  noted  that 
the  Grumman  system  has  no  provisions  for  analog  circuits,  so  the  testability 
FOM  applies  only  to  digital  PCBs  or  the  digital  portion  of  a  PCB.  The  column 
labeled  "Transformed  Grumman  Score"  is  a  linear  transformation  of  the  Grumman 
scores  onto  a  0.0  to  1.0  scale.  This  transformed  notation  is  used  for 
initial  card  (node)  testabilities  in  the  models  and  examples  of  sections  4.0 
and  5.0. 


The  four  basic  positive  factors  are  evaluations  of  percent  of  nodes 
accessible,  proper  documentation,  percent  sequential  circuits  used,  and  a  PCB 
complexity  count.  Two  of  these  factors,  percentages  of  nodes  accessible  and 
sequential  circuits,  are  closely  tied  to  the  testability  concepts  of 
controllability,  observability  and  predictability.  The  other  two, 
documentation  and  PCB  complexity,  deserve  further  explanation. 


Proper  documentation  in  the  form  of  schematics,  parts  lists,  board  layouts, 
and  detailed  I/O  signal  specifications  are  felt  to  improve  testability  simply 
by  making  the  test  engineer's  task  easier.  This  reduces  test  development  time 
and  hence  cost.  The  PCB  complexity  count  considers  the  type  and  number  of 


GRUMMAN  SCORE 

TRANSFORMED 

GRUMMAN 

SCORE 

ACTUAL  TESTABILITY 

+81  to  100 

.91  to  1.0 

Very  Easy 

+66  to  80 

.83  to  .90 

Easy 

+46  to  65 

.73  to  .82  , 

Medium/Easy 

+31  to  45 

.  66  to  .  72 

Medium 

+11  to  30 

.56  to  .65 

Hard 

+1  to  10 

.51  to  .55 

Very  Hard 

Less  than  1 

less  than, 51 

Impossible  to  test  without 
extreme  cost  penalty 

transformed  Grumman  Score* 


S.+1QQ 

200 


where  G  *  Grumman  Score  when  Grumman  Score  >  -100 
G  *  -100  when  Grumman  Score  <  -100 


*  Discussed  in  Section  5,0 


Table  3-1  RelationshlD  Between  Grumman 
Score  and  Testability 
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sequential  circuits.  It  differs  from  the  percent  sequential  factor  in  that  it 
considers  overall  board  size  and  component  types.  Small  Scale  Integration 
(SSI),  Medium  Scale  Integration  (MSI)  and  "simple”  LSI  integrated  circuits 
score  the  best  while  the  use  of  VLSI  circuits  (especially  memory  chips  and 
microprocessors)  is  heavily  penalized  because  of  the  large  number  of 
inaccessible  nodes  internal  to  the  chip. 


The  four  positive  factors  produce  a  maximum  positive  score  of  100. 


The  30  negative  factors  include  such  items  as  use  of  monostable  circuits, 
buried  memory,  non-initializable  sequential  circuits,  and  VLSI.  Other  factors 
address  the  areas  of  required  test  equipment  and  documentation.  Each  of  the 
negative  factors  is  weighted  in  accordance  with  its  impact  on  cost  and 
difficulty  of  testing.  The  maximwn  negative  score  is  infinite.  On  a 
practical  basis  though,  any  net  negative  score  indicates  that  a  card  is 
probably  difficult  to  test  and  a  large  negative  score  (e.g.,  -60)  indicates  it 
probably  will  take  much  effort  (and  cost)  to  adequately  test  the  card. 

3.1  Application  to  BAC  Systems 

Several  Boeing  designed  and  built  systems  were  surveyed  for  inclusion  in  this 
study.  The  three  that  were  chosen  were  the  Roland  Command/Control  Computer, 
the  ASAT  Flight  Control  Electronics  (FCE),  and  the  76 7  Flap/Slat  Electronics 
Unit  (FSEU).  These  systems  were  chosen  to  represent  typical  large,  medium, 
and  small  complexity  aerospace  systems.  The  Grumman  technique  was  applied  to 
the  PCBs  of  each  of  these  systems. 
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In  addition,  test  engineers  responsible  for  the  test  development  and  testing 
of  these  PCBs  were  interviewed  to  determine  their  testability  ratings  by 
experience.  The  results  of  this  work,  tabulated  In  tables  3-2,  3-3,  and  3-4, 
are  discussed  in  section  3.3.  Both  transformed  Grurtman  scores  and  Boeing  test 
experience  transformed  into  testability  scores  were  used  later  in  our 
testability  model  to  determine  system  level  testability. 

3.2  Summary  of  Grumman  Problem  Areas 

Our  experience  indicates  that  the  Grumman  testability  figure  of  merit  system 
is  quite  accurate  in  rating  the  testability  of  simple  digital  circuit  boards. 
However,  it  was  also  discovered  that  when  applied  to  more  complex  circuits  the 
accuracy  of  the  technique  is  diminished.  This  is  demonstrated  by  the  consis¬ 
tently  low  scores  generated  by  PCBs  which  use  microprocessors,  VLSI,  or  large 
quantities  of  memory.  The  Grumnan  technique  penalizes  the  mere  existence  of 
these  devices  with  little  or  no  regard  to  their  actual  testability  in  the  cir¬ 
cuit.  With  the  proliferation  of  microprocessor  based  systems,  the  Grumman 
scores  become  compressed  toward  the  low  end  of  the  scale.  Also,  many  of  the 
PCBs  evaluated  had  analog  circuits  on  them.  Since  the  Grumman  system  has  no 
provisions  for  analog,  these  portions  of  the  boards  were  ignored  in  this 
study. 

The  Grumman  PCB  FOM  still  has  merit  because  of  its  simplicity  and  ease  of  use. 
Because  of  this,  it  should  be  expanded  to  be  able  to  distinguish  between 
easily  testable  and  difficult  to  test  microprocessor,  VLSI,  and  memory 
circuits,  as  well  as  analog  circuits. 
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ASAT  Flight  Control  Electronics  Testability 
Table  3-2 


Roland  Command/Control  Computer  Testability 

Table  3-4 


3.3  Comparison  of  Grumman  PCB  Scores  to  Actual  Boeing  PCB  Test  Experience 

3.3.1  ASAT  Flight  Control  Electronics 

Table  3-2  shows  the  ASAT  Flight  Control  Electronics  PCB  testabilities.  The 
Grumman  scores  showed  a  general  trend  of  rating  each  PCB  as  being  somewhat 
more  difficult  to  test  than  Boeing  experience  Indicates.  The  exception  to 
this  is  the  serial  data  board  which  Boeing  test  personnel  rate  as  medium  while 
the  Grumman  method  rates  as  Impossible  to  test  without  high  cost.  Using  the 
Grumman  figure  of  merit,  points  were  deducted  for  a  high  percentage  of  non- 
Initializable  sequential  circuits.  Boeing  test  personnel  agreed  with  this, 
however,  patterns  have  been  developed  which  provide  an  initialized  state  for 
these  circuits  making  adequate  testing  possible.  Many  points  were  also 

deducted  for  use  of  memory  circuits  with  one  or  more  non-directly  accessible 
lines.  Simple  patterns  have  been  developed  to  access  each  memory  location 

making  testing  much  easier  than  predicted  by  the  Grumman  technique.  Because 
many  of  the  PCBs  in  the  ASAT  system  have  a  high  percentage  of  analog  circuitry 
(which  Is  not  addressed  by  the  Grumman  system),  only  five  of  the  ASAT  boards 
were  Included  in  this  evaluation.  These  cards  have  not  been  production  tested 
since  the  unit  is  still  in  engineering  development;  however,  an  engineering 

model  has  been  built.  System  testability  of  this  unit  is  calculated  and 

discussed  In  section  4.3.1. 

3.3.2  767  Flap/Slat  Electronics  Unit 

Table  3-3  shows  the  767  Flap/Slat  Electronics  Unit  testabilities.  At  the  time 
of  the  initial  interview,  Boeing  test  personnel  felt  the  Grumman  PCB  scores 


were  quite  accurate.  However,  since  that  time  improved  test  methods  have  been 
developed  resulting  in  better  testability  scores  for  the  CPU  and  Aux  I/O 
cards.  This  improvement  was  realized  through  advanced  ATE  techniques.  Boeing 
engineers  test  the  assembled  unit  using  ATE  also.  System  testability 
calculations  and  discussion  for  the  Flap/Slat  Electronics  Unit  is  in  section 
4.3.2. 


3.3.3  Roland  Command/ Control  Computer 


Table  3-4  shows  the  Roland  Command/Control  Computer  PCB  testabilities.  The 
majority  of  the  PCBs  were  found  to  have  actual  testabilities  which  correlated 
quite  closely  with  the  Grumman  scores.  The  exceptions  are  the  Central 
Processor  Unit  (CPU)  and  the  memory  boards.  The  CPU  card  contains  four  four- 
bit  microprocessors  in  a  bit  slice  arrangement  to  produce  a  16  bit  CPU.  The 
Grumman  testability  measure  deducts  points  for  each  of  these  four 
microprocessors.  Interviews  with  key  test  personnel  indicate  that  If  these 
four  microprocessors  are  approached  functionally  as  a  single  16-bit  CPU  then 
adequate  testing  is  not  difficult.  The  IK  RAM/4K  EPROM  memory  board  contains 
12  separate  memory  devices.  Because  each  of  these  devices  has  at  least  one 
line  which  is  not  brought  out  to  the  edge  connector  they  fall  into  the  Grumman 
category  of  buried  memory  devices  and  are  heavily  penalized.  In  actuality, 
only  simple  patterns  are  needed  to  access  the  contents  of  each  memory  location 
through  the  edge  connector.  Calculations  and  discussion  of  system  testability 
for  this  unit  is  in  section  4.3.3. 
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4.0  THE  TESTABILITY  MODEL 


The  general  approach  selected  for  the  development  of  the  testability  model  was 
to  represent  a  circuit  as  a  node-valued  weighted  graph.  The  nodes  represent 
circuit  substructure  (e.g.,  a  PCB)  for  which  a  testability  FOM  exists.  For 
example.  Figure  4.0-1  illustrates  a  simple  node-valued  weighted  model  of  a 
circuit.  An  arc  is  the  link  between  two  nodes.  The  weights  on  the  arcs  are 
given  by  W^j,  which  represents  the  influence  of  the  connection  between  node  i 
and  node  j.  The  node  testability  represents  the  testability  FOM  for  node  i. 
In  general,  there  are  two  types  of  node  testability:  (1)  Network  Dependent 
Node  Testability  (NDNT),  t^  which  is  the  testability  of  the  node  when  it  is 
embedded  in  the  network  and  (2)  Isolated  Node  Testability  (INT),  T.,,  which  is 
the  testability  of  the  node  outside  the  network.  A  subsystem  may  have  a  high 
isolated  node  testability  rating  and  a  very  low  network  dependent  node 
testability  if,  for  example,  it  is  embedded  deep  in  the  network  structure.  In 
general,  it  can  be  noted  that. 


If  the  nodes  are  PC  boards  then  the  isolated  node  testability  could  be  the 
Grumman  PCB  testability  FOM. 

In  terms  of  this  graph  model  the  steps  associated  with  the  development  of  a 
system  level  testability  rating  given  the  INT's  and  the  network  structure  are: 

(1)  Calculate  the  NDNTs  and  arc  weights 

(2)  Calculate  the  system  FOM 


Several  approaches  were  taken  to  develop  calculation  procedures  for  the  graph 

model.  These  approaches  are  summarized  in  4.1.  The  final  model  is  developed 

in  4.2.  Examples  of  the  application  of  the  model  are  given  in  4.3,  while  a 
verification  of  the  model  is  described  in  4,4. 

4.1  The  Model  Development  Process 

Initially,  three  candidate  approaches  for  the  testability  model  were 

suggested: 

o  Inverse  Signal  Reliability 

o  Pulse  Process  Analysis 

o  Modified  Hybrid  Systems  Analysis 

The  Inverse  Signal  Reliability  (ISR)  method  was  rejected  for  development  as 
part  of  this  project  since  it  would  not  lend  itself  to  incorporating  the 
Grumman  PCB  testability  measure.  However,  the  other  two  methods  were 

evaluated,  and  are  reviewed  in  the  following  two  sections. 

4.1.1  Pulse  Process  Method 

The  pulse  process  analysis  starts  with  a  signal  flow  graph  such  as  the  one 
shown  in  Figure  4. 1.1-1.  The  node  values  are  the  isolated  node  testabilities. 

The  goal  of  a  pulse  process  analysis  is  to  find  the  network  dependent  node 
testabilities  by  searching  for  a  stable  condition  in  equation  (9). 
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(9) 


n 

Ti(K+l)  «  Ti(K)  +  £  Aj.  Pj (K) 
j=l 

where  (K )  =  the  stability  criteria  at  stage  K 

A  =  the  weighted  adjacency  matrix 
i  =  the  node  in  question 
j  =  each  of  the  other  nodes  in  the  system 
Pj(K)  =  a  vector  of  length  n  representing  the  n  nodes  in  the  graph 
where: 


P j (0)  =  1  if  j  is  an  input  node 
Pj(0)  =  0  otherwise 

It  turns  out  that; 


P,(K*1)  E 
j*l 


P0.(K) 


for  each  i  and  j  =  1,  2,  3...n 


(10) 
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Rewriting  (10)  in  matrix  terms  results  in  equation  (11). 


P(K)  =  P(0)  AK 


The  result  is  that  equation  (9)  becomes  the  following  matrix  relationship: 


T(K+1)  =  T(K)  -*•  P(0)AK 


where  T  (K)  =  the  initial  testabilities  vector 


33 


(11) 


m 


(12) 


A  stable  condition  is  reached  when  T(K+1)  -  T(K)<  E  for  some  small  E£0  at 
stage  K.  The  new  values  of  T  are  transformed  into  the  network  dependent  node 
testabilities  using  equation  13. 


These  must  be  combined  to  form  a  single  system  level  measure  of  testability. 
One  possibility  would  be  to  average  the  network  dependent  node  testabilities. 
However,  a  formal  method  has  not  been  developed. 

For  the  example  system  in  Figure  4. 1.1-1,  the  weighted  adjacency  matrix  is: 

NODE 

TO 


1  2  3  4  5 


where  each  element,  A.j,  is  the  weight  of  the  connection  from  node  1  to 
node  j  if  there  is  one. 

Given  nodes  1  and  2  are  inputs,  the  vector  P  is  given  by: 

P(0)  =  (1  1  0  0  0) 
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Using  (10)  and  T(0),  the  Initial  testability  vector,  a  stable  condition  Is 
reached  at  k  =  2.  That  Is,  T(4)  *  T(3)  *  (1.0  2.0  3.9  2.7  2.4).  Using 

(13),  the  network  dependent  node  testabilities  for  this  system  are: 

(1  .71  .51  .61  .65) 

Using  an  averaging  method  over  the  network  dependent  node  testabilities  the 
overall  system  level  testability  is  .70. 

While  the  pulse  process  method  produces  some  interesting  results,  it  was 
decided  that  too  much  additional  research  and  development  was  required  in 
order  to  satisfactori ly  apply  this  method.  This  decision  was  due,  in  part,  to 
the  fact  that  the  Hybrid  Method  (see  next  section)  has  a  more  sound  theoretical 
base  to  tie  it  directly  to  the  concept  of  testability. 

4.1.2  Hyorid  Method 

The  second  approach  was  a  modification  of  Longendorfer's  Hybrid  Analysis 
Method  (10).  The  modified  hybrid  testability  FOM  is  based  on  a  graphical 
analysis  of  the  circuit  structure.  This  method  combines  circuit  elements  to 
form  interrelated  "nodes"  so  it  does  not  depend  on  the  function  of  a  circuit. 
As  a  result,  it  applies  to  both  analog  and  digital  systems.  In  the  hybrid 
analysis  method  the  testability  FOM  is  related  to  the  controllability  and 
observability  of  all  the  circuit  elements.  The  key  concept  is  that  the  deeper 
an  element  is  buried  in  a  circuit  the  more  difficult  it  is  to  control  and/or 
observe  the  operation  of  that  element.  In  other  words,  the  longer  the  path 
from  the  input  to  the  element  or  from  the  element  to  the  output,  the  lower  the 
testability  of  the  element. 
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In  general  the  hybrid  algorithm  requires  as  inputs: 


(a)  A  signal  flow  graph  of  the  circuit  in  the  form  of  a  connectivity  matrix 
for  the  elements. 

(b)  The  initial  testability  of  the  circuit  elements  stored  as  a  vector. 

Using  these  inputs,  the  algorithm  proceeds  through  a  series  of  five  stages 

leading  to  a  system  level  testability  FOM.  These  stages  are: 

(1)  Group  the  indistinguishable  elements  of  the  circuit  into  common  nodes 
(called  blocks).  This  is  done  by  calculating  a  reachability  matrix  for 
the  signal  flow  graph  using  a  procedure  developed  by  Ramamoorthy  in  1971 
for  graph  analysis.  The  reachability  matrix  is  then  analyzed  to  locate 
elements  with  indistinguishable  signal  flow  paths.  These  elements  are 
grouped  into  blocks  and  a  new  connectivity  matrix  is  constructed. 

(2)  A  new  initial  testability  assignment  is  given  to  each  block  which  is  the 
average  of  the  initial  testabilities  of  the  circuit  elements  in  each 
block. 

(3)  The  depth  of  each  block  in  the  circuit  is  determined  by  examining  the  new 
connectivity  and  reachability  matrices.  This  gives  the  arc  weights,  w. 

(4)  The  network  dependent  testability  values  are  calculated  for  each  block. 
They  are  given  by  the  initial  testability  divided  by  1  +  In  w.  Hence, 
the  testability  of  elements  decreases  as  their  depth  in  the  circuit 


increases. 


(5)  A  system  level  figure  of  merit,  T,  is  determined  based  on  the  network 
dependent  testability  values  and  the  circuit  structure  using 
Longendorfer's  methodology.  That  is. 


where 

P  3  The  percentage  of  direct  I/O  nodes  in  the  original  circuit 

B  =*  The  number  of  blocks  in  the  circuit  (found  in  step  1) 

t.j  =  The  network  dependent  testability  value  of  block  i 

Sj  *  Level  of  block  i 

For  example,  given  the  network  shown  in  Figure  4. 1.1-1,  the  connectivity 
matrix  is: 

To(j) 


Node  1  2  3  4  5 


where:  C^j  3  1  if  node  i  connects  to  node  j 


3  0  otherwise 


Using  C  as  input  along  with  the  initial  testability  values,  the  graph  reduces 
to  a  two  node  graph  as  shown  in  Figure  4. 1.3-1.  The  first  node  consists  of 
nodes  1,  2,  3,  and  4  in  the  original  graph  and  the  second  node  is  node  5  of 
the  original  graph.  The  initial  testabilities  and  NDNT  (from  step  4,  p.  36) 
for  the  reduced  graph  are: 


INITIAL 

NDNT 

1': 

.925 

1': 

.925 

2': 

.9 

2': 

.53 

and  the  system  level  testability  is  .63  (from  equation  (5),  p.  37)  which.  It 
should  be  noted,  is  close  to  the  .7  value  found  for  the  same  system  using  the 
pulse  process  method. 

4.2  The  Accessibility  Model 

After  an  extensive  analysis  of  the  modified  hybrid  model  it  was  determined 
that  it  had  two  problems: 

(1)  It  was  totally  insensitive  to  feedback. 

(2)  It  was  partially  insensitive  to  observability. 

That  is,  given  two  circuits  A  and  B  with  identical  nodes  and  forward 
interconnections  yet  allowing  A  to  have  a  feedback  loop,  the  modified  hybrid 
method  would  assign  the  same  testability  values  to  both  circuits.  However,  it 
is  well  known  that  feedback  lines  introduce  testing  problems  and  as  a  result 


such  circuits  are  not  as  easy  to  test  as  the  same  circuit  without  feedback. 
In  addition,  the  testability  of  a  circuit  evaluated  using  the  modified  hybrid 
method  would  only  increase  slightly  with  the  addition  of  an  observation  point 
while  it  would  increase  substantially  with  the  addition  of  a  new  control 
point.  This  imbalance  between  the  effects  of  observation  points  and  the 
effects  of  control  points  on  system  testability  does  not  reflect  the  real 
world  of  testing  and  actual  testing  costs. 


As  a  result  of  the  two  problems  noted  above,  the  modified  hybrid  model  was 
restructured  introducing  the  concept  of  accessibility  of  a  node.  The  acces¬ 
sibility  of  a  node  is  determined  by  the  accessibility  of  all  the  nodes 
connected  to  it  in  a  signal  path  from  the  input  to  the  output  in  the  following 


(1)  Node  N . j  is  at  level  i  and  is  node  number  j.  The  level  is  the  number  of 
nodes  in  the  longest  path  from  an  input  to  the  node,  plus  1. 


(2)  The  accessibility  (A..)  of  all  nodes  at  level  1  (input  nodes)  is  equal  to 

*  J 


(3)  The  accessibility  of  an  interior  node  N.  ,  is  the  sum  of  the  products  of: 


(a)  The  accessibility  (A..)  of  node  N..  in  a  line  segment  connected 

i  J  •  J 

directly  to  Nt1  . 
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(b)  The  arc  weight  of  node  Nkl  given  by  Qkl. 


where  din  (N^)  =  the  number  of  arcs  entering  node  Nkl  for  k  t  1 


(c)  The  initial  testability  (T^)  of  node  N^j. 

In  general,  the  accessibility  of  an  interior  node  is  given  by  equation  14: 


Aij  Qkl 


(14) 


The  sum  in  equation  14  is  over  all  nodes  that  are  the  source  of  an  input  arc 
to  node  Nk1  .  For  example,  given  the  system  shown  in  Figure  4.2-1,  the  number 
inside  the  node  is  its  initial  testability  (T^.)  and  the  accessibilities  (A^.) 
of  nodes  1  and  2  are  both  1  since  they  are  level  1  input  nodes.  In  a  strict 
formation  of  the  nodal  graph  structure,  a  node  of  initial  testability  of  1  is 
added  to  indicate  input  or  output  to  the  system.  (These  nodes  are  not 
physical  hardware.)  For  example,  node  2  in  Figure  4.2-1  indicates  that  node  4 
has  inputs  from  outside  the  system.  Likewise,  node  7  shows  outputs  from  node 
5  to  outside  the  system.  These  could  be  considered  controllability  and 
observability  points  of  the  system.  However,  if  a  node  is  pure  input  or 
output  this  is  not  necessary.  For  example,  node  3  of  Figure  4.2-1  is  pure 
input  (all  system  arcs  lead  away  from  it).  In  this  case,  node  1  could  be 
eliminated  with  no  affect  on  the  accessibility  and  testability  calculations. 


The  accessibility  of  node  3  is  given  by  the  following: 


A23  s  ah  Q23  Tn  =  1  x  1  x  1  =  1  - 

r 

The  accessibility  of  node  5  which  is  at  level  5  depends  on  the  accessibilities 
of  nodes  3  and  6  which  are  connected  to  node  5: 

t 

A55  =  A23  Q55  T23  +  A46  Q55  T46 
=  1  X  .5  X  .8  +  .72  X  .5  X  .8  =  .69 


The  network  dependent  node  testabilities  (t^)  are  determined  by  the  product 
of  the  accessibility  of  a  node  and  its  initial  testability. 

* 


tij  =  Aij  Tij 


The  system  level  testability  calculation  method  is  a  three  step  process: 


(a)  Find  all  the  paths  from  the  inputs  to  the  outputs. 

(b)  Calculate  a  path  testability,  Tp,  for  each  path  using  the  following: 


where  Mp  *  number  of  nodes  in  path 

tn  *  network  dependent  node  testability  for  each  node  along 
path. 
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(c)  Calculate  the  system  testability  T$  which  is  the  weighted  average  of  the 
path  testabilities: 


M  =  number  of  paths 


The  system  testability  for  the  example  of  Figure  4.2-1  is  .70.  The  network 
dependent  node  testabilities  (NDNT)  and  path  testabilities  are  shown  in  Figure 
4.2-2  and  Figure  4.2-3. 

Another  example  of  the  application  of  this  approach  is  illustrated  using  the 
system  shown  in  Figure  4.2-4.  The  accessibility  and  NDNT  of  each  node  is 
shown  in  Figure  4.2-5.  The  overall  testability  of  Figure  4.2-4  is  .62.  After 
an  examination  of  Figure  4.2-4,  it  is  clear  that  node  6  with  an  initial 
testability  of  .6  and  an  NDNT  of  .43  is  a  problem.  One  way  to  increase  the 
system  testability  then,  would  be  to  redesign  node  6  such  that  its  initial 
testability  is  raised  to,  for  example,  .9.  The  effect  on  the  circuit  is  shown 
in  Figure  4.2-6.  The  system  testability  is  raised  to  .67,  almost  a  10% 
increase. 

An  example  of  what  might  be  done  when  the  initial  testability  of  a  PCB  can't 
be  increased  for  one  reason  or  another  is  illustrated  by  Figure  4.2-7,  which 
shows  a  more  complicated  system  made  up  of  18  nodes  representing  PCB's.  The 
results  of  a  testability  analysis  of  this  circuit  is  shown  in  Figure  4.2-8. 
The  system  level  testability  is  .58.  If  an  extra  control  point  (Node  20)  is 
added  to  PCB  13  and  another  observation  point  is  placed  on  PCB  9  (Node  19), 
the  resulting  testability  calculations  are  shown  in  Figure  4.2-9.  The  new 
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Figure  4.2-3:  Path  Testability  of  Figure  4.2-1 
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Figure  4.2-5:  Testability  of  Figure  4.2-4 
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Example  3 


Figure  4.2-6:  Increased  Testability  of  Figure  4.2-4 
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Figure  4.2-8:  Testability  of  Figure  4.2-7 
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Example  4  With  Added  Control  and  Observation  Points 
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Figure  4.2-9:  Increased  Testability  of  Figure  4.2-7 


system  testability  value  is  .63  which  registers  a  slight  gain  even  for  a 
system  as  large  as  this  one. 

Finally,  the  response  of  the  accessibility  model  to  feedback  is  illustrated  in 
the  following  two  examples.  Consider  initially  the  simple  case  of  five  PCB's 
connected  in  series  as  shown  in  Figure  4.2-10.  The  testability  calculations 
are  given  in  Figure  4.2-11.  The  testability  of  this  system  is  .85.  Now  if 
feedback  is  added  between  PCB's  4  and  2  as  shown  in  Figure  4.2-12  the  NDNT's 
are  reduced  as  given  in  Figure  4.2-13.  The  overall  testability  is  also 
reduced  as  shown. 


The  accessibilities  are  determined  using  equation  14. 


Akl  *?Aij  Qkl  Tij 


A11 

*  1 

A22 

"  A11 

q22 

T11  +  A44  Q22  T44 

»  .  5( . 

,95)  + 

A33 

=  a22 

Q33 

T22 

=  A22 

(.95) 

A44 

*  A33 
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In  this  case  is  an  input,  so  its  accessibility  is  1.  Since  A22  is 

dependent  on  A44,  A^  is  dependent  on  A33,  and  A33  is  dependent  on  A22,  the 
accessibilities  must  be  solved  as  a  set  of  simultaneous  equations: 


A44  “  A33 
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The  remaining  accessibilities  and  system  testability  are  given  in  Figure 
4.2-13. 
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4.3  Application  to  BAC  Equipment 


The  accessibility  model  algorithm  was  programmed  in  the  Pascal  computer 
language  and  applied  to  the  three  BAC  systems  identified  in  section  3.0: 
ASAT,  the  767  Flap/Slat  Unit,  and  the  Roland  Command  Computer.  Two  programs 
were  used;  one  (Input-Graph)  to  construct  the  node  graph  structure,  and  the 
other  (Testability)  to  determine  system  testability.  The  source  listings  of 
these  programs  are  in  Appendix  I.  The  following  proposed  scale  for  system 
testability  evaluation  is  used  in  the  discussions  that  follow  for  each  of 
those  BAC  systems: 


BAC  System 
Testability  Score 


Testability 

Rating 


The  boundaries  for  the  individual  testability  rating  categories  ("impossible," 
"hard,"  .  .  .  etc)  were  derived  via  means  which  were  similar  to  the  way  in 
which  the  spread  for  the  Grumman  PCB  testability  technique  was  derived.  The 
spread  for  system  testability  for  the  categories  above  "impossible"  was  set 
from  .16  to  1.0  rather  than  .51  to  1.0  (see 
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Figure  4.2-13:  Testability  of  Figure  4.2-12 


table  3-1),  and  judgement  based  on  system  testing  experience,  in  addition  to 
the  character  of  the  system  rating  process,  slightly  changed  the  way 
individual  categories  were  bounded  as  well. 

The  application  of  the  system  testability  score  involved  comparing  the  FOM 
scores  for  Boeing  designed  subsystems,  calculated  using  the  Accessibility 
Model  ("BAC  System  Testability  Score") ,  to  independent  "Testability  Ratings" 
for  the  same  hardware  made  by  Boeing  test  engineers.  Some  care  was  taken  in 
interpreting  these  assessments  to  specifically  account  for  the  following  two 
facts: 

(1)  The  use  of  extensive  and  expensive  BIT  and  ATE  can  make  even  the  most 
untestable  design  look  adequate. 

(2)  Engineering  assessments  regarding  testability  during  development  (prior 
to  test  engineering)  are  often  more  pessimistic  than  the  final 
assessments  after  the  test  engineering  design  phase. 

Both  of  these  factors  must  be  considered  and  accounted  for  in  any  comparison 
of  this  type. 

The  results  of  the  application  are  summarized  In  the  remainder  of  this 
section. 

4.3.1  ASAT  Flight  Control  Electronics 

The  ASAT  system  consists  of  five  PCB's  that  result  in  the  graph  structure  for 
board  interconnection  paths  shown  in  Figure  4. 3. 1-1.  The  initial 


1  Ignition  Discrete 

2  Servo/amp/bit 

3  Serial  data 

4  Gyro  wheel  supply 

5  Outputs  (not  physical  PCB) 

6  Gyro  Demod/excitation 


Figure  4. 3. 1-1:  Graph  Structure  for  the  ASAT  Unit 


testabilities  for  the  five  PCB's  (Figures  4. 3. 1-1  and  4. 3. 1-2)  were  determined 
using  the  Grumman  Method.  Node  5,  in  the  graph,  represents  an  output  point 
for  the  system  and  has  an  initial  testabilty  of  1  (it  is  not  a  physical  PCB). 

The  overall  system  testability  using  the  transformed  Grunman  PCB  testability 
numbers  is  .25,  or  hard  to  test.  (Note  that  the  range  of  Grumman  FOM  numbers 
is  changed  to  a  range  of  0.0  to  1.0  as  shown  in  Table  3-1).  When  numbers 
based  on  current  Boeing  PCB  test  experience  are  substituted  for  the  Grumman 
numbers  (see  Figure  4. 3. 1-3),  the  resultant  system  testability  is  calculated 
as  .49,  or  medium  in  testability  difficulty.  Test  experience  on  the 
engineering  model  of  the  system  (it  is  not  yet  in  production)  has  shown  the 
unit  to  be  hard  to  test,  (which  is  in  more  agreement  with  the  result  using  the 
Grumman  PCB  numbers).  This  result  is  not  surprising,  since  functional  test 
engineering  is  yet  to  be  completed,  and  during  development,  electronic  items 
are  often  judged  more  complex  to  test  than  when  they  are  in  production.  This 
is  due  to  the  fact  that  functional  test  engineering  trails  development  tasks. 
A  good  example  of  this  was  in  the  development  of  the  767  Flap  Slat  unit 
described  in  Section  4.3.2.  The  initial  data  we  obtained  (before  the  unit  was 
in  full  production)  resulted  in  a  determination  of  the  system  as  hard  to  test. 
By  the  end  of  this  contract,  with  the  box  in  full  production  and  with  the 
support  of  a  modest  amount  of  ATE,  this  system  is  now  judged  medium  in 
difficulty  of  testing.  Because  of  this  example  (and  others),  BAC  test 
engineers  believe  that  when  functional  test  design  is  complete  and  ATE  is 
available,  the  ASAT  unit  will  be  in  the  moderate  or  medium  range  of 
testability  difficulty. 

4.3.2  767  Flap/Slat  Unit 
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The  767  Flap/Slat  Unit  is  part  of  the  digital  control  system  for  the  767 
flaps.  A  basic  block  diagram  is  shown  in  Figure  4. 3. 2-1.  Using  the  initial 

testabilities  for  the  three  PCB's  derived  from  the  Grumman  Method,  the  block 
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Figure  4. 3. 1-3:  ASAT  Testability  Using  BAC  Initial  Testabilities 


diagram  is  translated  directly  into  the  graph  shown  in  Figure  4. 3. 2-2.  Nodes 
1  and  3  in  the  graph  represent  the  I/O  points  for  the  system  and  have  initial 
testabilities  of  1  {they  do  not  represent  physical  PCB's).  Note  that  this 
simple  unit  has  feedback  links,  so  most  testability  FOM's  will  not  work  on  the 
system.  However,  the  Accessibility  Model  produces  the  results  shown  in  Figure 
4. 3. 2-3. 

The  overall  system  testability  using  the  Grumman  testability  numbers  is  .31. 
When  numbers  based  on  Boeing  PCB  testing  experience  are  substituted  for  the 
Grumman  numbers  (Figure  4. 3. 2-4)  the  system  testability  is  calculated  to  be 
.40.  Qualitatively,  use  of  Grumman  PCB  numbers  puts  the  system  on  the  hard 
side  of  the  "border"  of  being  hard-to-medium  in  testability;  use  of  Boeing 
experience  places  it  at  the  lower  range  of  medium  testability.  This  result  of 
medium  testability  was  consistent  with  Boeing  test  experience  for  the  black 
box  using  a  modest  amount  of  the  factory's  Automated  Test  Equipment. 

4.3.3  Roland  Command  Computer 

The  Roland  Command  Computer  consists  of  8  interconnected  digital  PCB's  which 
produce  the  data  paths  shown  in  Figure  4. 3. 3-1.  The  other  6  cards  were  analog 
and  didn't  apply  themselves  to  the  Grumman  technique,  therefore  they  were  not 
used  for  this  model.  Five  I/O  point  nodes  with  an  initial  testability  of  1 
have  been  added  to  the  graph  to  represent  the  system  input/output  points. 

The  system  testability  FOM  using  the  Grumman  PCB  variables  is  calculated  as 
.03  (Figure  4. 3. 3-2).  This  results  in  an  "impossible  to  test  without  cost 
penalty"  rating;  this  is  to  be  expected,  since,  according  to  the  Grumman 
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Figure  H, 3, 2-3:  Testability  of  767  Flap/Slat  Unit 
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Figure  4. 3. 3-1  Graph  Structure  For  the  Roland  Command  Computer 
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Figure  4. 3. 3-2:  Testability  of  Roland  Command  Computer 


rating,  three  of  the  PCB's  are  "impossible"  to  test  and  two  of  them  are  "hard" 
to  test.  However,  the  Grumman  FOMs  reflect  an  underrating  of  the  initial 
testabilities  of  the  CPU  and  memory  units.  Using  the  Boeing  test  engineer's 
evaluation  of  the  testabilities  of  these  PCB's  (rather  than  the  Grumman  FOM) 
for  the  initial  node  (PCB)  values  and  rerunning  the  Accessibility  Model 
results  in  a  system  testability  value  of  .23,  a  "hard"  to  test  level.  Summary 
data  for  this  calculation  is  shown  in  Figure  4. 3. 3-3. 

The  calculated  "hard-to-test"  level  for  the  Roland  Command  Computer  using  the 
Accessibility  Model  is  consistent  with  both  the  degree  of  difficulty  of 
testing  the  PCB's  in  the  system,  and  the  degree  of  difficulty  that  Is 
associated  with  testing  the  system  without  the  aid  of  a  sophisticated  test 
system  designed  especially  for  the  computer.  This  is  especially  true 
considering  that  one  card,  the  Sequencer,  is  considered  just  inside  the 
impossible-to-test-without-cost-penalty  range  even  by  the  Boeing  test 
personnel.  During  engineering  model  checkout  it  was  considered  very  hard  to 
test  by  the  engineers  (no  ATE  was  available).  However,  those  same  people  now 
judge  the  overall  commmand  computer  as  easy  to  test  as  a  system.  The  reason 
for  this  can  be  attributed  to  the  development  of  an  extensive  and  relatively 
expensive  test  system,  which  would  not  have  necessarily  been  needed  had  the 
design  been  endowed  with  a  higher  level  of  testability  (the  sequencer  card  in 
particular).  The  bottom  line  is  that  given  enough  ATE,  sufficient  test 
engineering  resources,  and  some  cleverness  (insight)  in  design  of  the  test 
procedures,  many  difficulties  can  be  overcome  (but  at  a  high  cost). 

a.  When  the  Roland  command  computer  was  initially  designed,  considerable  and 
difficult  troubleshooting  was  required  to  detect  and  isolate  faults  even 
when  self-test  and  Special  Test  Equipment  (STE)  was  used. 
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b.  Because  of  the  degree  of  difficulty  in  testing  this  subsystem,  the  Roland 
Program  put  their  best  test  engineers  on  the  job  designing  both  ATE 
software  and  an  interface  adapter  to  go  between  the  ATE  and  the  Roland 
Command  Computer. 

c.  Because  a  fairly  large  production  run  was  anticipated  and  the  contract 
required  that  fairly  low  level  maintenance  personnel  to  be  able  to 
troubleshoot  the  subsystem,  a  relatively  costly  test  development  effort 
was  economically  justified. 

d.  The  resultant  test  hardware  and  software  has  proven  itself  in  the  manu¬ 
facturing  area.  Accurate  fault  diagnosis  and  isolation  to  the  card  level 
are  possible  very  quickly  using  the  ATE.  This  is  what  the  manufacturing 
test  engineers  base  their  easy  rating  on  for  the  box. 

An  additional  sidelight  on  the  Sequencer  card  also  demonstrates  the 
completeness  and  cleverness  of  their  test  approach.  That  card  is  so  complex 
and  difficult  to  test  that  the  present  card  test  (theoretically  simpler  than  a 
subsystem  test)  sometimes  misses  faults  and  passes  a  card.  The  subsystem  test 
is  good  enough  that  it  detects  those  sequencer  faults  and  isolates  them  to 
that  PCB. 

4.4  Summary 

As  can  be  seen  from  the  examples  in  Section  4.3,  use  of  the  Grumman  PCB  test¬ 
ability  numbers  tends  to  give  a  more  pessimistic  view  of  a  card's  and  a 
system's  testability.  When  VLSI  devices  are  used,  it  can  be  considerably  more 


pessimistic  than  test  experience  justifies.  Further,  another  point  brought 
out  in  comparing  the  BAC  Accessibility  Model  to  actual  experience  is  that  the 
results  of  using  this  model  will  be  in  fairly  close  agreement  with  actual  test 
results  when  the  unit  reaches  production.  However,  if  more  than  normal  design 
effort  is  devoted  to  test  design  using  ATE  and  special  adapters,  better,  even 
much  better,  testability  can  be  achieved  than  one  would  anticipate  from  the 
testabilities  of  the  individual  cards  and  the  controllability,  observability 
and  accessibility  of  them  when  interconnected.  In  the  end  it  is  a  matter  of 
economics;  testability  of  inherently  hard-to-test  subsystems  can  be  improved. 
However,  the  best  economic  approach  is  to  design  good  testability  into  the 
subsystem  in  the  first  place.  Use  of  Grumman,  BAC  Accessibility  or  any  F.O.M. 
approach  during  the  design  phase  will  reduce  both  production  costs  during 
manufacturing  test  and  system  life  cycle  costs  in  the  field. 

Further  development  of  F.O.M.  techniques  so  they  can  be  used  as  practical 
design  tools  in  a  Computer  Aided  Engineering  environment  is  recommended.  This 
is  a  necessary  first  step  in  providing  the  design  engineer  with  the  tools  he 
needs  to  design  testability  into  the  system  as  an  integral  part  of  the  design 


process. 


5.0  System's  Application  Example 


The  Accessibility  Model  developed  in  section  4.2  meets  the  initial  cri 
for  a  testability  measure  which  can  extend  the  Grumman  measure  to  the  s 
level.  The  entire  process  is  illustrated  in  the  following  simplified  exan 

Given  the  simple  system  shown  in  Figure  5.1-1  consisting  of  the  intercc 
tions  of  five  subsystems,  the  testability  of  this  system  may  be  calci 
using  the  Accessibility  Model.  Each  subsystem  consists  of  an  interconn* 
of  PCB's  as  shown  in  Figures  5.1-2a  to  5.1-2e. 

As  an  example,  the  testability  of  subsystem  1  (figure  5.1-2a)  wi' 

determined. 

o  Step  one:  determine  i  and  j 

Each  node  is  represented  by  "N .  Node  Ni ■  is  at  level  i  and  is  node  r 

j.  The  level  is  the  number  of  nodes  in  the  longest  path  from  an  input  t 
node,  plus  1.  In  subsystem  1  (SSI)  let  j  be  the  PC  number  of  each  node. 

There  are  no  nodes  from  the  input  to  node  1,  so  the  level  of  node  1 

There  is  one  node  from  the  input  to  node  2,  so  the  level  of  node  2 

There  are  2  nodes  (1  and  2)  in  the  longest  path  from  the  input  to  node 
node  3  is  at  level  3.  Likewise,  node  4  is  at  level  3.  So,  PCI  is  N^,  I 

N 22'  PC^  N33»  and  is  ^34* 

Step  two:  determine  . 


The  accessibility  of  a  node.  A..,  at  level  1  is  equal  to  one. 

*  J 

Nllf  by  definition  of  "i"  is  the  only  node  at  level  one. 
Therefore,  only  is  equal  to  1. 


o  Step  three:  determine  A.. 

*  J 


The  accessibility  of  an  interior  node  (i  >  1)  is  given  by: 


kl  Akl  Qij  Tkl 


The  sum  in  the  equation  is  over  all  nodes  that  are  the  closest  source  of  an 
input  to  N--.j  • 

■  J 


Tkl  is  the  initial  testability  of  N|^ .  Tkj  is  determined  using: 

6kl  +  100 
Tkl  * - ZOO — 

where:  Tkl  =  the  transformed  Grumman  testability  of  Nkl 

Gk1  =  the  Grumman  FOM  when  the  Grumman  FOM  £  -100 
Gkl  =  -100  when  the  Grumman  FOM  <-100 


Gkj  for  each  node  in  SSI  is  given  in  figure  5.1-3.  Using  these  values,  T^  * 
(90  +  100)  t-  200  *  .95.  The  rest  are  given  in  figure  5.1-3. 


is  the  arc  weight  of 


Q.jj  is  determined  using  the  following: 


12 


Figure  5.1-3:  Transformed  Grumman  Scores  of  Figures 
5.1-2a  through  5.1-2e 


where 


Q1j  “  d1nlN1j) 

din(Nij)  3  the  number  of  arcs  entering  N^j 

not  defined,  and  not  required  since  Is  determined  in  step  2.  By 
Inspection  of  figure  5.1-2a,  N22  has  one  arc  entering  it.  So  Q22  *  1  t  1  *  1. 
N33  has  2  arcs  entering  it,  so  Q33  3  1  -f  2  3  .50.  Also,  Q34  3  1.0. 

A^j  is  the  accessibility  of  Ny  A^  was  defined  in  step  2  as  one.  The  other 
accessibilities  are  calculated  next: 

A22  =  Q22  ^"11  a  1  x  1  x  .95  = 

A33  3  A^j  Q33  ^  A22  Q33  T22  =  lx.5x.95  +  .95x.5x.80  3  .86 

A^j  3  A22  0^3  T22  ~  .95  x  1  x  .80  3  .76 

0  Step  four:  determine  NDNT 

NDNT  is  the  network  dependent  nodal  testability  or  "t..". 

*  J 

The  NDNT  is  calculated  using  the  following: 
tij  =  Aij  Tij 

Using  this  equation,  tn  3  An  Tn  3  1  x  .95  3  .95.  The  other  NDNTs  are 
likewise  calculated  and  shown  in  figure  5.1-4a. 

0  Step  five:  determine  Tp 


84 


v  vV ' 


*  o  ■  "  * 


. 


•.  /.  .  V 
•  \  *  •«* 


Tp  is  the  path  testabilities  of  the  system.  First,  determine  all  the  possible 
paths  through  SSI.  In  this  case,  there  are  three: 

Path  1  N11  N22  N33 

Path  2  Nn  N22  N34 

Path  3  Nn  N33 

Tp  is  calculated  using  the  following: 


where  Mp  =  number  of  nodes  in  the  path 

tn  =  NDNT  of  each  node  along  the  path 

For  SSI,  Tp  for  Path  1,  (Tp)^  is  found  next: 


(Tp) 2  and  (Tp) 3  are  determined  in  the  same  manner.  Their  values  are  given  in 
figure  5.1-4a. 

Step  six:  determine  T$ 


0 


Ts  is  the  overall  system  testability.  It  is  calculated  using  the  following 
equation: 


Ts  4  w  Tyr) _1 


where  M  =  number  of  paths  in  the  system. 

For  SSI,  T$  is  calculated  next: 

<TS>1  -  [Uryi  *  ryj  +  tt^)]'1 

fi  /  i  1  1  \"|-1 

=  I  \7ST  +  755  +  7S5 ) 


Using  the  table  in  section  4.3.1,  SSI  would  be  easy  to  test. 

The  six  step  procedure  is  repeated  for  each  of  the  four  remaining  subsystems. 
The  results  are  given  in  figures  5. l~4b  through  5.1-4e.  Next,  the  testability 
of  the  overall  system  comprised  of  the  five  subsystems  is  determined  (figure 
5.1-1).  For  this  calculation,  T  of  each  subsystem  becomes  T-.  for  the 

^  1 J 

overall  system: 
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Subsystem  Testability 
Figure  5.1-4e 
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Subsystem  Testability 


Figure  5.1-5 

System  Level  Testability 


The  six  step  procedure  Is  followed  and  an  overall  system  T$  is  found.  The 
result  Is  shown  In  Figure  5.1-5.  This  system  Is  difficult  to  test  with  a 
testability  value  of  only  .38  on  a  scale  of  0  to  1.  An  examination  of  the 
testability  calculations  at  the  system  level  Indicates  that  subsystems  3  and  4 
must  be  redesigned  to  Improve  their  testability.  A  stop  gap  measure  may  also 
be  applied  as  seen  from  Figure  5.1-5.  Subsystem  five  has  a  low  NONT  and  a 
high  Initial  testability.  This  results  from  the  fact  that  the  only  control 
over  subsystem  five  occurs  through  the  low  testable  subsystems  three  and  four. 
Testability  could  be  improved  by  placing  a  test  point  on  the  inputs  to 
subsystem  five  as  shown  in  figure  5.1-6.  The  results  of  this  modification  on 
testability  are  shown  in  Figure  5.1-7.  The  addition  of  an  added  test  point 
increased  the  NDNT  of  subsystem  five  to  .51  or  by  70%.  This  resulted  in  an 
Increase  in  all  the  path  testabilities  and  an  overall  increase  in  the  system 
testability  to  .47,  or  by  24%. 

5.1  Future  Research  Possibilities 

While  the  accessibility  model  seems  to  provide  an  adequate  measure  of 
testability  which  can  be  used  at  any  system  level,  the  problem  of  developing  a 
measure  of  testability  which  could  be  generally  accepted  Is  far  from  solved. 
Among  further  development  possibilities  are: 

(a)  Continued  Validation 

The  accessibility  model  requires  a  large  number  of  validation  experiments  for 
the  results  to  be  statistically  acceptable.  Doing  this  would  be  most 
meaningful  If  a  PCB  level  testability  rating  system  approach  that  accommodated 
VLSI  were  available  (see  Item  (c)). 


(b)  A  Test  Point  Location  System 

One  advantage  of  a  testability  FOM  such  as  the  measure  based  on  the 
Accessibility  Model  Is  Its  ability  to  guide  the  process  of  test  point 
selection.  Research  needs  to  be  done  on  the  effects  of  test  points  on 
testability  as  measured  by  the  FOM.  The  results  of  such  research  would  be  a 
set  of  guidelines  for  test  point  location. 

(c)  Development  of  an  Improved  PCB  Testability  Rating  System 

The  Grumman  rating  system  has  many  shortcomings  when  applied  to  current 
designs  using  VLSI  components  and  results  In  extremely  understated  testability 
ratings  at  times.  The  Grunman  technique  does  have  enough  value,  however,  that 
It  Is  worth  modifying  to  accommodate  VLSI  until  a  rigorous  PCB  level  FOM  can 
be  developed.  Efforts  In  both  modifying  the  Grumman  technique  and  research  In 
developing  a  truly  rigorous  PCB  level  FOM  should  be  Initiated  concurrently. 


6.0  SUMMARY 
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The  overall  objective  of  this  program  was  to  extend  the  current  PCB 
testability  design  and  rating  system  developed  by  Grumman  to  the 
subsystem/system  levels  and  to  generate  an  overall  system  level  testability 
figure  of  merit.  After  an  extensive  survey  of  current  approaches  to 
testability  FOM's  It  was  determined  that  a  graph  model  would  best  meet  the 
given  objective.  Two  graph  models  were  constructed  based  on  two  different 
analysis  techniques: 


0  Pulse  Process  Analysis 
0  Hybrid  Systems  Analysis 


A  preliminary  analysis  of  these  two  techniques  demonstrated  that  a 
modification  of  the  hybrid  systems  analysis  approach  would  best  satisfy  the 
requirements  of  an  effective  testability  FOM.  Application  of  that  approach  to 
three  BAC  systems  validated  applicability  of  the  FOM  measure  when  the  baseline 
Grumman  PCB  scores  were  modified  to  reflect  actual  PCB  test  experience  for 
cards  containing  VLSI  memory  chips  and  microprocessors. 
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APPLICATION  COMPUTER  PROGRAM 


PROGRAM  INGRAPH  (XNPUT/OUTPUT, OUTPILE) f 

CONST  MAXalOOf 
NEGa-lf 

TYPE  PXLETYPEafZLE  OP  CHARf 

VAR  OUTPXLEl  PXLETYPEf 

XNTESTl  ARRAY  Cl, .MAX)  OP  REALf 
NODEB,LOOPAS,X, J,K,Pt  INTEGER I 
CXRNAMEt  PACKED  ARRAYCI*«40)  OP  CHARf 

BEGIN 


OPENC  OUTPILE , 'DATA * , MEN  )f 
REWRITE(OUTPXLE) f 

POR  Xtai  TO  25  DO  NRITELNf 

HRITELN  ('  INPUT  INITIAL  DATA')! 

NRITELNf 

NRITELNf 

NRITELNC 'ENTER  CIRCUIT  NAME'ff 
NRITELNf 

READLN(CIRNAME) f 
NRITELN (OUTPILE, CXRNANE)f 

NRITELNf 

NRITELNf 

NRXTELNC 'INPUT  NUMBER  OP  FEEDBACK  LOOP  ITERATIONS') f 

READLN(LOOPAS) f 

NR ITELN ( OUTPILE , LOOP AS ) f 

NRITELNf 

NRITELN  ('INPUT  NUMBER  OP  NODES') f 

READLN ( NODES )f 

NRITELNf 

NR I TELM ( OUTPILE / NODES ) f 
NRITELNf 

POR  Xial  TO  NODES  DO 
BEGIN 
Pl«lf 
NRITELNf 

NRITELN ('INPUT  INITIAL  TESTABILITY  OP  NODE  ',I)» 

READLN (INTEST (I ))f 
NHZLE  P>0  DO 
BEGIN 
NRITELNf 

NRITELN ('NUMBER  OP  A  NODE  NZTH  AN  ARC  STARTING  AT  NODE', I) f 

NRITELN ('ENTER  0  TO  STOP')f 

NRITELNf 

READLN(P)f 

IP  P>0  THEN  NRZTELN(OUTPXLE,X,P)f 
ENDf 


PROGRAM  TESTABILITY (INPUT, OUTPUT, INFILE)! 


CONST  MAXSIZEslOOf 

TYPE  FILETYPE*FILE  OF  CHAR; 

ARRAYTYPEbARRAY (l MAX SIZE, 1., MAXSXZE)  OF  REAL! 
ROWYYPEbARRAY[1..MAXSIZE)  OF  REAL* 
P0INT1«*STACK1) 

STACK iaRECORD 

NODE! INTEGER! 

NEXT I POXNT1 ! 

END! 

P0INT2a*STACK2; 

STACK 2*RECORD 

NxNODEj INTEGER; 

BP: INTEGER; 

LXNK(POXNT2! 

end; 

POINT3«"STOR ExPATH | 

STORExPATHbRECORD 
TESTY  t REAL; 

HEADERtPOXNTl! 

LINKER: POXNT3; 

END; 


VAR 

HEADN,m,TN2:P9XNTl; 

HEADP,TP1 ,TP2(P9INT2; 

HEADF,TF1 , TF2(P0XNT3; 

CYCLE: ARRAY  Cl • •MAXSXZE)  OF  INTEGER; 

nv,curxnode;integer; 

TEST  ,X,J,K,V,W,p, NODES, TOP, CTOP , NPATH (INTEGER t 
INFILE:FILETYPE| 

SUM, PATHXLENGTH (REAL; 

trans, con, tempcon:arraytype; 

ACCESS, INTXIEST,0,NDNT,PArHxTEST(RONTYPE; 

PATHXC0ST(ARRAYC0..MAXSIZE,0.,1]  OF  REAL; 

STACK;ARRAYC1., MAXSXZE, O..U  OF  INTEGER; 

PATH(ARRAYtl,,MAXSIZE,0..1I  OF  REAL; 

SUM2,TESTABILITY(REAL; 

loop: BOOLEAN; 

ipvt:rowttpE; 

result:rohtype; 

SUMROw,SUNCOL(ARRAY  Cl,. maxsizej  of  real; 
cirname:  PACKED  ARRAYC1..40J  of  char; 

PROCEDURE  PUSHNC DATA: INTEGER; VAR  HEAD J POINT1 ) ; 
BEGIN 

NEM(TNl); 

tni*.node:bdata; 

tni*,next:bheao; 

head:bTN1; 

end; 

PROCEDURE  PUSHP(0ATA,BRANCH(INTEGER); 

BEGIN 

NEN(TPl); 

tpia.nxnode:«data; 

TP1*,8P;bBRANCH; 

tpi*.link:bheadp; 

HEADP(BTPl; 

end;  99 


PROCEDURE  POPNJVAR  DATA (INTEGERS VAR  HEADtPOXNTi) f 
BEGIN 

DATA (aHEAD** NODES 
TNliaHEADS 
HE AD I *HE AD*. NEXT I 
DISPOSE(TNl) f 
ENDS 

PROCEDURE  POPPS 
BEGIN 

TP2(sHEADPs 
HEADPS«HEADP*. LINKS 
DXSPOSE(TP!)S 
ENDS 

PROCEDURE  SETUPS 
BEGIN 

POR  It»l  TO  NODES  DO 
BEGIN 
SUNtaOs 

FOR  J Sal  TO  NODES  DO 
BEGIN 

SUMCOLtll saSUNCOLClJ+CONt J,I1 S 
SUMRQ«(IJ  SaSUNROWtIJ+CONlI, JJ  S 
ENDS 

IF  SUNCOLCIJ  <>  0  THEN 
FOR  Kl*l  TO  NODES  DO 

TENPCONCK.il saCONCK.XI/SUNCOLtl) 

ELSE 

BEGIN 

ACCESS  Cl] (a»l s 
PUSHPC X# ROUND ( SUMROM IX] ) ) S 
FOR  Kial  TO  NODES  DO 
IF  CON(X#K]al  THEN 
PU8HN(K,HEADN)S 

ENDS 

ENDS 

FOR  I  sal  TO  NODES  DO 
BEGIN 

FOR  Jt«l  TO  NODES  DO 

TEMPCON (I ,  JJ  |aTENPCON(X,J]*ZNTxTESTms 
TEMPCON (I ,1] *a-lS 
ENDS 

FOR  I  sal  TO  NODES  DO 
FOR  Jial  TO  NODES  DO 

TRANSIX* J) (aTEMPCON I J# I] S 

MRXTELNS 

NRITELNC 'PRIMARY  NODES  VECTORS ') f 

MRXTELNS 

MRXTELNS 

FOR  X(al  TO  NODES  DO 

MRITE( ACCESS  IX] iSlO )S 
MRITELNS 


MRXTELNS 

MRXTELNS 

MRXTELNl 'CONNECTIVITY  NATRXXS'JS 

MRITELNS 

MRXTELNS 

MRXTELNl 'FROM  NODE  S  TO  NODE  ')( 
MRXTELNS  10B 


writec* 


•>> 

FOR  I*«l  10  NODES  DO  WRlTECXtS)! 

NRITELNI 

WRirei.NI 

for  it«l  to  nodes  do 
begin 

wRire(xt4)i 
for  1i*i  to  nodes  do 
wrlte(contl*1) t6t0)i 
vrltelni 
MRITEUN) 
end; 

ENOl 


PROCEDURE  50LVACCC VAR  At ARR A YTYPElNt INTEGER! VAR  BtRONTYPE)! 

VAR  I ,  J  ,K  t INTEGER! 

SUM, MULTFACl REAL! 

BEGIN 

FOR  J!*l  TO  N  DO 
BEGIN 

IF  A (J, J)  <>0  THEN 
BEGIN 

FOR  I**(J+1>  10  N  00 
BEGIN 

IF  Ad.JjOO  THEN 
BEGIN 

MULTFAC:«ACl,Jl/A{J,J)  I 
FOR  Kt*l  TO  N  00 

AfI»Fl l*AtI,K) •NULTFACSA l J  #Kl I 
Bill t«BlI)*MULTFAC«BtJ)» 

ENDt 

ENO» 

END 

ELSE 

NRITELNI' ERROR  —  ACCESSABILITIES  NOT  ATTAINED')! 

END! 

WRITEM! 

NRITELNI 

NRITELNI' FORWARD  ELIMINATION  OF  ACCESSABILITIES  COEFFICIENTS') 
WRITELN | 

WRITELN | 

FOR  1 1  *1  TO  N  DO 
BEGIN 

FOR  Jl«l  TO  N  DO 

*RZTE(RtI,J)l6l?>l 

NRITELNI 

NRITELNI 

END! 

NRITELNI 

NRITELNI 

FOR  I ! >N  DONNTO  1  DO 
BEGIN 

IF  AII.IJOO  THEN 
BEGIN 
SUMt»0.0| 

FOR  Jt«I  TO  N  DO 

IF  IOJ  THEN  SUN|»SUH*A[I,JJ*BtJ]  I 

9tI)l«(8m-SUN)/ACI,I)| 


PROCEDURE  PATHFINDER! 


BEGIN 

WHILE  (HEADPONIL)  AND  (HEADNONIL)  DO 
BEGIN 

POPN ( CURxNODE » HEADN ) ! 

HEADP*. BPl-HEADP*. BP-1 1 

WHILE  (CYCLE (CURxNODE)  >  NV)  AND  (HEADP  <>  NIL)  DO 
BEGIN 

IP  HEADP*. BP<*0  THEN 
BEGIN 

L00Pl«PAL8E| 

WHILE  (HEADPONIL)  AND  (NOT  LOOP)  DO 
BEGIN 

IP  HEADP*. BP<*0  THEN 
BEGIN 

CYCLE  (HEADP*  .NXNODE)  I  ■CYCLE  [HEADP*  .NxN0DE)«l! 

POPP! 

END 

ELSE 

LOOP|*TRUE! 

END! 

ENO! 

IP  HEADNONIL  THEN 
BEGIN 

POPN (CURxNODE « HEADN) ! 

HEADP*. BP t*HEADP*.BP-l! 

END! 

END! 

IF  HEADPONIL  THEN 
BEGIN 

CYCLE [CURxNODE) S aCYCLE( CURXNODE) +| ! 

PUS HP (CURXNODE. ROUND (SUNROW (CURxNODE)  ) ) ! 

IF  SUMROW (CURXNODE) >0  THEN 
BEGIN 

FOR  I 1*1  TO  NODES  DO 

IF  CON(CURXNODE.I)*1  THEN 
PUSHN(I.HEAON)! 

END 

ELSE 

BEGIN 

KS*0! 

NEN(TFl)! 

TN2l*NIL! 

TF1 *. LINKER I *HEADF! 

TF1*,TESTY|«0! 

HEADFt*TFl! 

LOOP I "FALSE! 

WHILE  (HEADPONIL)  AND  NOT(LOOP)  00 
BEGIN 

IF  HEADP*. BP<*0  THEN 
BEGIN 

PUSHN ( HEADP*. NXNOOE. TN2 ) ! 

TF1 *. TEST Y!*TFi*.TESTVf(l/NDNT (HEADP*. NxNODE) ) ! 
CYCLE (HEADP*. NXNODE) faCYCLE [HEADP*. NXNODE) •!! 
KiaKtl! 

POPP! 

END 

ELSE  LOOPtaTRUE! 

END!  )|2 


LOOP ! ■FALSE* 

TP2iaHEADP* 

WHILE  (TP2  <>  NIL)  AND  NOT(LOOP)  DO 
BEGIN 

PU8HN{TP2*'MXNOOE,TN2)f 

TF1  *  , TESTY I ■TPi •. TESTV* C  t /NDNT  t TP2* .NxNODE) > I 
K|aK*l; 

IF  SUWC0L(TP2*.NXN0DE)>0  THEN 
TP2taTP2A.LINK 
ELSE 

LOOPtaXRUE) 

END* 

Tri-.TESnri«K/frivrESTv» 

TF1*. HEADER laTNj; 

END) 

END! 

end; 

END! 

<*  *) 

(*  START  OF  WAIN  PROGRAM  *) 

C*  *) 

BEGIN 

OPEN  (INFILE* 'DATA' » OLD) ; 

RESET  ( INFILE) ; 

READLNCINFILE* CIRNAME) | 

NRlTELN; 

WRITELN  (*****************  A******************************************'); 
NRlTELN; 

WRITELN; 

WRITE ( 'TESTABILITY  ANALYSIS  OF  ')) 

FOR  I S ■  1  TO  40  DO 

WRITE(CIRNANE(I) ); 

WRITELN; 

WRITELN; 

MITEL»l('»;«**«»**«**MM*M**MMM***»*M***M«**MM**MMM*»')j 

WRITELN) 

WRITELN) 

READLNCINFILEf NY) ; 

READ C INFILE *NODES); 

READLN(  INFILE  #!(«)); 

WHILE  (I>aO)  AND  (J>aO)  DO 
BEGIN 

Conii ( j) 1*1 ; 

TCNPCONII#J)*al; 

READLN(INFILEdrJ); 

END) 

FOR  It*i  TO  NODES  DO 

REAOLNCINFILEt INTxT£8T(I] ) ; 

(^INITIALIZE  ACCESS ABILITY  VECTOR*) 

SETUP; 

(*  NICKI'S  ROUTINE  *) 

in 


WRITELNy 

NRXTELNt 'ACCESS ABILITY  COEFFICIENTS*') » 
WRITELNy 

FOR  1 1*1  TO  NODES  DO 
BEGIN 

POR  J««t  TO  NODES  00 

WRXTE(TRAN8 (I , J) S6t2)y 
HRITELNf 
WRITELNy 
ENDy 

SOLVACC( TRANS, NODES, ACCESS) y 

WRITELNy 

WRITELNy 

WRITELNy 

WRITELNy 

POR  I yal  TO  NODES  DO 

NDNT(I) y«ACCES8(I] *XNTxTEST[I] y 


{•OUTPUT  NETWORK  VALUES*) 

WRITELNy 

WRITELNy 

WRITELNy 

WRITELN( 'NETWORK  VALUES') t 

WRITELNy 

WRITELNy 

WRITELNf 'NODE' 1 5. 'INITIAL  TESTABILITY' 1 22, ' ACCESS ABI LI TY ' 1 17. 'NDNT'l  15)  I 
WRITELNy 

POR  I I«1  TO  NODES  DO 

WRITELNCI t4« INTxTEST (X)  122(2,  ACCESSCH  tlT*2,N0RT(Il  tt5(2)y 
WRITELNy 
WRITELNy 

(*PIND  THE  PATH  TESTABILITIES  AND  THE  INPUT  NODES*) 

PATHFINDER y 

(•OUTPUT  PATH  TESTABILITIES*) 

WRITELNf 'THE  NUNBER  OP  PATH  ITERATIONS  WAS  ',NVl2)y 
WRITELNy 

WRITELNf 'EACH  PATH  TESTED  FOLLOWS*')) 

WRITELNy 

TPliaHEADPy 
WHILE  TPIONIL  DO 
BEGIN 

WRITELN('PATH»')y 
TNI  I *TE1“, HEADER y 
WHILE  TNIONIL  DO 
BEGIN 

*RXTE(TNl*.N0DEt3,*  :  )f 

TNI  * ■TNI*, NEXT? 

ENDy 

WRITELNy 

WRXTELNt'PAIH  TESTABILITY  ■  ' ,TPl *,TE8TV | 4 t 2) y 

WRITELNy 

WRITELNy 

TF1 I •TF1“ .LINKER y 
ENDy  1M 


MRimm 

MRXTEbNf 

MRXTEbNf 

MRXTEbN; 

MRXTEbNf 


(♦CALCULATE  SYSTEM  TESTABILITY*) 

SUM 1*0 I 
TPlt«HEA0Ff 
MHILE  rriONIb  00 
BEGIN 

SUM*«SUM+l/TFl*.TESTVf 

NPATHt»NPAT4+l; 

TPiiaTFl*. LINKER! 

ENDf 

TESTABIbITYl*NPATH/SUNf 

MRITEbNf 

MRXTEbNf 

MRXTEbN( '  SYSTEM  TESTABILITY  »  ',IESTABlLITY**»2)f 
END. 


Appendix  II 

List  of  Acronyms  and  Abbreviations 

ATE  Automatic  Test  Equipment 

CNO  Cannot  Duplicate 

OFT  Design  for  Testability 

FCE  Flight  Control  Electronics 

FOM  Figure  of  Merit,  or  Testability  Figure  of  Merit 

FON  Fault  Occurrence  Networks 

FSEU  Flap/Slat  Electronics  Unit 

INT  Isolated  Node  Testability 

ISR  Inverse  Signal  Reliability 

LRU  Line  Replaceable  Unit 

LSI  Large  Scale  Integration 

LSSD  Level  Sensitive  Scan  Design 

MSI  Medium  Scale  Integration 

MTBF  Mean  Time  Between  Failures 

NDNT  Network  Dependent  Node  Testability 

PCB  Printed  Circuit  Board 

RADC  Rome  Air  Development  Center 

SSI  Small  Scale  Integration 

TTM  Testability  Transfer  Matrix 

VLSI  Very  Large  Scale  Integration 


Since  the  testability  contributions  of  many  nodes  are  to  be 
considered  In  obtaining  a  single  subsystem  or  system  flgure- 
of-merit,  some  sort  of-averaglng  means  must  be  used  to  obtain 
that  value.  The  harmonic  mean  (the  reciprocal  of  the  sum  of 
the  reciprocals  of  the  values)  was  chosen  as  the  averaging  tech 
nlque.  This  form  of  average  Is  relatively  Insensitive  to  ex¬ 
treme  values „  and  weights  the  average  value  towards  the  less 
testable  components  or  nodes.  This  result  Intuitively  seems 
to  be  most  logical  and  consistent  with  engineering  experience. 
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MISSION 

of 

Rome  Air  Development  Center 

RA VC  plant  and.  execute*  research,  development,  test  and 
&  elected  acquisition  programs  In  Aupport  of  Command,  Control 
CoimunicatlonA  and  Intelligence  (C3 1)  activities.  Technical 
and  engineering  Support  within  areas  of  technical  competence 
is  provided  to  ESP  Program  OHic.es  IPO A)  and  other  ESP 
elements.  The  principal  technical  mission  areas  are 
communications,  electromagnetic  guidance  and  control,  sur¬ 
veillance  of  ground  and  aeMApace  objects.  Intelligence  data 
collection  and  handling,  information  AyAtem  technology, 
lonoApheAlc  propagation,  Aolid  Atate  Aclences,  microwave 
phyAlcs  and  electronic  reliability,  maintainability  and 
compatibility. 
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